LLM OS

LLM OS is a concept proposed by Andrej Karpathy

An LLM in a few years:¹

It can read and generate text
It has more knowledge than any single human about all subjects
It can browse the internet
It can use the existing software infrastructure (calculator, Python, mouse/keyboard)
It can see and generate images and video It can hear and speak, and generate music It can think for a long time using a System 2
It can “self-improve” in domains that offer a reward function
It can be customized and fine-tuned for specific tasks, many versions exist in app stores It can communicate with other LLMs

Footnotes